Image processing method and apparatus, and electronic device

ABSTRACT

An image processing method is provided. The image processing method is configured to process the color-block image output by the image sensor. The brightness area is identified in the color-block image. A first part of the color-block image within the brightness area is converted into a first image using a first interpolation algorithm. The second part of the color-block image beyond the brightness area is converted into a second image using a second interpolation algorithm. The first image and the second image are merged to generate a simulation image corresponding to the color-block image. Moreover, an image processing apparatus and an electronic device are provided.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of U.S. application Ser.No. 15/803,521, filed Nov. 3, 2017, which is based on and claimspriority of Chinese Patent Application No. 201611099894.X, filed on Nov.29, 2016, the entire contents of which are incorporated herein byreference.

FIELD

The present disclosure relates to the imaging technology field, and moreparticularly to an image processing method, an image processingapparatus, and an electronic device.

BACKGROUND

When an image is processed using a conventional image processing method,either the obtained image has a low resolution, or it takes a long timeand too many resources to obtain an image with high resolution, both ofwhich are inconvenient for users.

DISCLOSURE

The present disclosure aims to solve at least one of existing problemsin the related art to at least some extent. Accordingly, the presentdisclosure provides an image processing method, an image processingapparatus, and an electronic device.

Embodiments of the present disclosure provide an image processingmethod. The image processing method is configured to process acolor-block image output by an image sensor. The image sensor includesan array of photosensitive pixel units. Each photosensitive pixel unitincludes a plurality of photosensitive pixels. The color-block imageincludes image pixel units arranged in a preset array. Each image pixelunit includes a plurality of original pixels. Each photosensitive pixelunit corresponds to one image pixel unit, and each photosensitive pixelcorresponds to one original pixel. The image processing method includes:identifying a brightness area in the color-block image; converting afirst part of the color-block image within the brightness area into afirst image using a first interpolation algorithm, in which, the firstimage includes first simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one first simulation pixel;converting a second part of the color-block image beyond the brightnessarea into a second image using a second interpolation algorithm, inwhich, the second image includes second simulation pixels arranged in anarray, each photosensitive pixel corresponds to one second simulationpixel, and a complexity of the first interpolation algorithm is greaterthan that of the second interpolation algorithm; and merging the firstimage and the second image to generate a simulation image correspondingto the color-block image.

Embodiments of the present disclosure further provide an imageprocessing apparatus. The image processing apparatus is configured toprocess a color-block image output by an image sensor. The image sensorincludes an array of photosensitive pixel units. Each photosensitivepixel unit includes a plurality of photosensitive pixels. Thecolor-block image includes image pixel units arranged in a preset array.Each image pixel unit includes a plurality of original pixels. Eachphotosensitive pixel unit corresponds to one image pixel unit, and eachphotosensitive pixel corresponds to one original pixel. The imageprocessing apparatus includes a non-transitory computer-readable mediumincluding computer-readable instructions stored thereon, and aninstruction execution system which is configured by the instructions toimplement at least one of an identifying module, a first convertingmodule, a second converting module and a merging module. The identifyingmodule is configured to identify a brightness area in the color-blockimage. The first converting module is configured to convert a first partof the color-block image within the brightness area into a first imageusing a first interpolation algorithm, in which, the first imageincludes first simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one first simulation pixel. Thesecond converting module is configured to convert a second part of thecolor-block image beyond the brightness area into a second image using asecond interpolation algorithm, in which, the second image includessecond simulation pixels arranged in an array, each photosensitive pixelcorresponds to one second simulation pixel, and a complexity of thefirst interpolation algorithm is greater than that of the secondinterpolation algorithm. The merging module is configured to merge thefirst image and the second image to generate a simulation imagecorresponding to the color-block image.

Embodiments of the present disclosure provide an electronic device. Theelectronic device includes a housing, a processor, a memory, a circuitboard, a power supply circuit, and an imaging apparatus. The circuitboard is enclosed by the housing. The processor and the memory arepositioned on the circuit board. The power supply circuit is configuredto provide power for respective circuits or components of the electronicdevice. The imaging apparatus includes an image sensor. The image sensoris configured to output a color-block image. The image sensor includesan array of photosensitive pixel units. Each photosensitive pixel unitincludes a plurality of photosensitive pixels. The color-block imageincludes image pixel units arranged in a preset array. Each image pixelunit includes a plurality of original pixels. Each photosensitive pixelunit corresponds to one image pixel unit, and each photosensitive pixelcorresponds to one original pixel. The memory is configured to storeexecutable program codes. The processor is configured to run a programcorresponding to the executable program codes by reading the executableprogram codes stored in the memory, to perform the image processingmethod according to embodiments of the present disclosure.

Additional aspects and advantages of embodiments of present disclosurewill be given in part in the following descriptions, become apparent inpart from the following descriptions, or be learned from the practice ofthe embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects and advantages of embodiments of the presentdisclosure will become apparent and more readily appreciated from thefollowing descriptions made with reference to the drawings.

FIG. 1 is a flow chart of an image processing method according to anembodiment of the present disclosure.

FIG. 2 is a block diagram of an image sensor according to an embodimentof the present disclosure.

FIG. 3 is a schematic diagram of an image sensor according to anembodiment of the present disclosure.

FIG. 4 is a flow chart illustrating a process of identifying abrightness area in the color-block image according to an embodiment ofthe present disclosure.

FIG. 5 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure.

FIG. 6 is a schematic diagram of an array of filter units according toan embodiment of the present disclosure.

FIG. 7 is a schematic diagram of a merged image according to anembodiment of the present disclosure.

FIG. 8 is a schematic diagram of a color-block image according to anembodiment of the present disclosure.

FIG. 9 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to an embodiment ofthe present disclosure.

FIG. 10 is a schematic diagram illustrating a process of converting apart of color-block image into a first image according to an embodimentof the present disclosure.

FIG. 11 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 12 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 13 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 14 is a schematic diagram illustrating a process of converting acolor-block image into a second image according to an embodiment of thepresent disclosure.

FIG. 15 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure.

FIG. 16 is a block diagram of an identifying module according to anembodiment of the present disclosure.

FIG. 17 is a block diagram of a first converting module according to anembodiment of the present disclosure.

FIG. 18 is a block diagram of a third determining unit in the firstconverting module according to an embodiment of the present disclosure.

FIG. 19 is a block diagram of a first converting module according toanother embodiment of the present disclosure.

FIG. 20 is a block diagram of an electronic device according to anembodiment of the present disclosure.

EMBODIMENTS OF THE PRESENT DISCLOSURE

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings, in which the sameor similar reference numbers throughout the drawings represent the sameor similar elements or elements having same or similar functions.Embodiments described below with reference to drawings are merelyexemplary and used for explaining the present disclosure, and should notbe understood as limitation to the present disclosure.

In the related art, an image sensor includes an array of photosensitivepixel units and an array of filter units arranged on the array ofphotosensitive pixel unit. Each filter unit corresponds to and coversone photosensitive pixel unit, and each photosensitive pixel unitincludes a plurality of photosensitive pixels. When working, the imagesensor is controlled to be exposed to light to output a merged image.The merged image includes an array of merged pixels, and a plurality ofphotosensitive pixels in a same photosensitive pixel unit arecollectively outputted as one merged pixel. Thus, a signal-to-noiseratio of the merge image is increased. However, a resolution of themerged image is reduced.

Certainly, the image sensor can be controlled to output a color-blockimage with a high amount of pixels, which includes an array of originalpixels, and each photosensitive pixel corresponds to one original pixel.However, since a plurality of original pixels corresponding to a samefilter unit have the same color, the resolution of the color-block imagestill cannot be increased. Thus, the color-block image with the highnumber of pixels needs to be converted into a simulation image with ahigh amount of pixels by an interpolation algorithm, in which thesimulation image includes a Bayer array of simulation pixels. Then, thesimulation image can be converted into a simulation true-color image byan image processing method and saved. The resolution of the true-colorimage may be improved by using the interpolation algorithm. However, theinterpolation algorithm consumes resource and time, thereby taking along time to capture pictures and making user experience poor.Furthermore, not all of applications need to be processed with theinterpolation algorithm or need to output the simulation true-colorimage.

Thus, embodiments of the present disclosure provide a novel imageprocessing method.

Referring to FIG. 1, an image processing method is illustrated. Theimage processing method is configured to process a color-block imageoutput by an image sensor to obtain a simulation image. The imageprocessing method is applied in an electronic device. As illustrated inFIGS. 2 and 3, the image sensor 20 includes an array 212 ofphotosensitive pixel units and an array 211 of filter units arranged onthe array 212 of photosensitive pixel units. The array 211 of filterunits includes a plurality of filter units 211 a, and the array 212 ofphotosensitive pixel units includes a plurality of photosensitive pixelunits 212 a. Each filter unit 211 a corresponds to and covers onephotosensitive pixel unit 212 a, and each photosensitive pixel unit 212a includes a plurality of photosensitive pixels 2121 adjacent to eachother. The color-block image includes image pixel units arranged in apreset array. Each image pixel unit includes a plurality of originalpixels. Each photosensitive pixel unit 212 a corresponds to one imagepixel unit, and each photosensitive pixel 2121 corresponds to oneoriginal pixel. The image processing method includes the following.

At block 110, a brightness area is identified in the color-block image.

At block 120, a first part of the color-block image within thebrightness area is converted into a first image using a firstinterpolation algorithm.

The first image includes first simulation pixels arranged in an array,and each photosensitive pixel corresponds to one first simulation pixel.

At block 130, a second part of the color-block image beyond thehigh-brightness area is converted into a second image using a secondinterpolation algorithm.

The second image includes second simulation pixels arranged in an array,and each photosensitive pixel corresponds to one second simulationpixel.

The first interpolation algorithm is more complex than the secondinterpolation algorithm.

At block 140, the first image and the second image are merged togenerate a simulation image corresponding to the color-block image.

With the image processing method according to embodiments of the presentdisclosure, by identifying the high-brightness area and processing thehigh-brightness area of the color-block image using the firstinterpolation algorithm, a high quality image can be obtained and asituation that it takes too much work to process the whole frame ofimage using the first interpolation algorithm can be avoided, thusimproving work efficiency.

For the area with high brightness, distinguishability of the imagewithin the high-brightness area can be improved by processing the areausing the first interpolation algorithm. For the area with lowbrightness, since the noise in the area is high, the benefit ofimproving the distinguishability of the image using the firstinterpolation algorithm is not obvious. Further, the complexity of thefirst interpolation algorithm includes the time complexity and the spacecomplexity, which are greater than those of the second interpolationalgorithm. Therefore, it is advantageous to process the area with highbrightness using the first interpolation algorithm and process the areawith low brightness using the second interpolation algorithm withcomplexity less than that of the first interpolation algorithm. Not onlythe quality of image can be improved, but also the time required forprocessing data and image can be reduced, thus improving the userexperience.

Referring to FIG. 4, in some implementations, the act at block 110includes the following.

At block 1101, the color-block image is divided into a plurality ofanalysis areas.

In some embodiments, the plurality of analysis areas are arranged in anarray.

At block 1102, a brightness value of each of the plurality of analysisareas is calculated.

At block 1103, analysis areas each with a brightness value greater thana preset threshold are combined into the brightness area.

In some implementations, the color-block image is divided into M*Nanalysis areas. The brightness value is calculated for each of the M*Nanalysis areas. For each analysis area, the brightness value is comparedwith the preset threshold. When the brightness value is greater than thepreset threshold, the corresponding analysis area having the brightnessvalue can be considered as being in the brightness area. During animaging process, the part within the brightness area may be processedwith the first interpolation algorithm to obtain an image with a highquality.

In some implementations, each analysis area includes one or moreoriginal pixels.

It can be understood that, in some implementations, each original pixelof the color-block image may be considered as one analysis area, i.e.,the brightness value of each original pixel is compared with the presetthreshold. The original pixels with the brightness value greater thanthe preset threshold are combined as being in the brightness area. Thepart of the color-image in the brightness area is processed with thefirst interpolation algorithm to obtain a high quality image.

FIG. 5 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure. FIG. 6 is aschematic diagram of an array of filter units according to an embodimentof the present disclosure. FIGS. 2-3 and 5-6 are better viewed together.

Referring to FIGS. 2-3 and 5-6, the image sensor 20 according to anembodiment of the present disclosure includes an array 212 ofphotosensitive pixel units and an array 211 of filter units arranged onthe array 212 of photosensitive pixel units.

Further, the array 212 of photosensitive pixel units includes aplurality of photosensitive pixel units 212 a. Each photosensitive pixelunit 212 a includes a plurality of adjacent photosensitive pixels 2121.Each photosensitive pixel 2121 includes a photosensitive element 21211and a transmission tube 21212. The photosensitive element 21211 may be aphotodiode, and the transmission tube 21212 may be a MOS transistor.

The array 211 of filter units includes a plurality of filter units 211a. Each filter unit 211 a corresponds to one photosensitive pixel unit212 a.

In detail, in some examples, the filter units 211 a are arranged in aBayer array. In other words, four adjacent filter units 211 a includeone red filter unit, one blue filter unit and two green filter units.

Each photosensitive pixel unit 212 a corresponds to a filter unit 211 awith a same color. If a photosensitive pixel unit 212 a includes nadjacent photosensitive elements 21211, one filter unit 211 a covers nphotosensitive elements 21211 in one photosensitive pixel unit 212 a.The filter unit 211 a may be formed integrally, or may be formed byassembling n separate sub filters.

In some implementations, each photosensitive pixel unit 212 a includesfour adjacent photosensitive pixels 2121. Two adjacent photosensitivepixels 2121 collectively form one photosensitive pixel subunit 2120. Thephotosensitive pixel subunit 2120 further includes a source follower21213 and an analog-to-digital converter 21214. The photosensitive pixelunit 212 a further includes an adder 2122. A first electrode of eachtransmission tube 21212 in the photosensitive pixel subunit 2120 iscoupled to a cathode electrode of a corresponding photosensitive element21211. Second electrodes of all the transmission tubes 21212 arecollectively coupled to a gate electrode of the source follower 21213and coupled to an analog-to-digital converter 21214 through the sourceelectrode of the source follower 21213. The source follower 21213 may bea MOS transistor. Two photosensitive pixel subunits 2120 are coupled tothe adder 2122 through respective source followers 21213 and respectiveanalog-to-digital converters 21214.

In other words, four adjacent photosensitive elements 21211 in onephotosensitive pixel unit 212 a of the image sensor 20 according to anembodiment of the present disclosure collectively use one filter unit211 a with a same color as the photosensitive pixel unit 212 a. Eachphotosensitive element 21211 is coupled to a transmission tube 21212correspondingly. Two adjacent photosensitive elements 21211 collectivelyuse one source follower 21213 and one analog-digital converter 21214.Four adjacent photosensitive elements 21211 collectively use one adder2122.

Further, four adjacent photosensitive elements 21211 are arranged in a2-by-2 array. Two photosensitive elements 21211 in one photosensitivepixel subunit 2120 can be in a same row.

During an imaging process, when two photosensitive pixel subunits 2120or four photosensitive elements 21211 covered by a same filter unit 211a are exposed to light simultaneously, pixels can be merged, and themerged image can be outputted.

In detail, the photosensitive element 2121 is configured to convertlight into charges, and the amount of the charges is proportional to anillumination intensity. The transmission tube 21212 is configured tocontrol a circuit to turn on or off according to a control signal. Whenthe circuit is turned on, the source follower 21213 is configured toconvert the charges generated through light illumination into a voltagesignal. The analog-to-digital converter 21214 is configured to convertthe voltage signal into a digital signal. The adder 2122 is configuredto add two digital signals for outputting and processing.

Referring to FIG. 7, take an image sensor 20 of 16 M as an example. Theimage sensor 20 according to an embodiment of the present disclosure canmerge photosensitive pixels of 16 M into photosensitive pixels of 4 M,i.e., the image sensor 20 outputs the merged image. After the merging,the photosensitive pixel 2121 quadruples in size, such that thephoto-sensibility of the photosensitive pixel 2121 is increased. Inaddition, since most part of noise in the image sensor 20 is random,there may be noise points at one or two pixels. After fourphotosensitive pixels 2121 are merged into a big photosensitive pixel,an effect of noise points on the big photosensitive pixel is reduced,i.e., the noise is weakened and SNR (signal to noise ratio) is improved.

However, when the size of the photosensitive pixel is increased, thepixel value is decreased, and thus the resolution of the merged image isdecreased.

During an imaging process, when four photosensitive elements 21211covered by a same filter unit 211 a are exposed to light in sequence, acolor-block image may be output after an image processing.

In detail, the photosensitive element 21211 is configured to convertlight into charges, and the amount of charges is proportional to anillumination intensity. The transmission tube 21212 is configured tocontrol a circuit to turn on or off according to a control signal. Whenthe circuit is turned on, the source follower 21213 is configured toconvert the charges generated by the photosensitive element 21211 underlight illumination into a voltage signal. The analog-to-digitalconverter 21214 is configured to convert the voltage signal into adigital signal for processing.

Referring to FIG. 8, take an image sensor 20 of 16 M as an example. Theimage sensor 20 according to an embodiment of the present disclosure canoutput photosensitive pixels of 16 M, i.e., the image sensor 20 outputsthe color-block image. The color-block image includes image pixel units.The image pixel unit includes original pixels arranged in a 2-by-2array. The size of the original pixel is the same as that of thephotosensitive pixel 2121. However, since a filter unit 211 a coveringfour adjacent photosensitive elements 21211 has a same color (i.e.,although four photosensitive elements 21211 are exposed to lightrespectively, the filter unit 211 a covering the four photosensitiveelements 21211 has a same color), four adjacent original pixels in eachimage pixel unit of the output image have a same color, and thus theresolution of the image cannot be increased.

The image processing method according to an embodiment of the presentdisclosure is able to process the color-block image to obtain asimulation image.

It some embodiments, when a merged image is output, four adjacentphotosensitive pixels 2121 with the same color can be output as onemerged pixel. Accordingly, four adjacent merged pixels in the mergedimage can be considered as being arranged in a typical Bayer array, andcan be processed directly to output a merged true-color image. When acolor-block image is output, each photosensitive pixel 2121 is outputseparately. Since four adjacent photosensitive pixels 2121 have a samecolor, four adjacent original pixels in an image pixel unit have a samecolor, which form an untypical Bayer array. However, the untypical Bayerarray cannot be directly processed. In other words, when the imagesensor 20 adopts a same apparatus for processing the image, in order torealize a compatibility of the true-color image outputs under two modes(i.e., the merged true-color image under a merged mode and thesimulation true-color image under a color-block mode), it is required toconvert the color-block image into the simulation image, or to convertthe image pixel unit in an untypical Bayer array into pixels arranged inthe typical Bayer array.

The simulation image includes simulation pixels arranged in the Bayerarray. Each photosensitive pixel corresponds to one simulation pixel.One simulation pixel in the simulation image corresponds to an originalpixel located at the same position as the simulation pixel in thecolor-block image.

Referring to FIG. 9, in some implementations, the act at block 120(converting the first part of the color-block image into the first imageusing the first interpolation algorithm) includes the following.

At block 1202, it is determined whether a color of a first simulationpixel is identical to that of an original pixel at a same position asthe first simulation pixel, if yes, an act at block 1204 is executed,otherwise, an act at block 1206 is executed.

At block 1204, a pixel value of the original pixel is determined as apixel value of the first simulation pixel.

At block 1206, the pixel value of the first simulation pixel isdetermined according to a pixel value of an association pixel.

The association pixel is selected from an image pixel unit with a samecolor as the first simulation pixel and adjacent to an image pixel unitincluding the original pixel.

For a frame of color-block image, the first part of the color-block isconverted into a first image arranged in the Bayer array and isprocessed using the first interpolation algorithm. Referring to FIG. 10,for the first simulation pixels R3′3′ and R5′5′, the correspondingoriginal pixels are R33 and B55.

When the first simulation pixel R3′3′ is to be obtained, since the firstsimulation pixel R3′3′ has the same color as the corresponding originalpixel R33, the pixel value of the original pixel R33 is directlydetermined as the pixel value of the first simulation pixel R3′3′ duringconversion.

When the first simulation pixel R5′5′ is to be obtained, since the firstsimulation pixel R5′5′ has a color different from that of thecorresponding original pixel B55, the pixel value of the original pixelB55 cannot be directly determined as the pixel value of the firstsimulation pixel R5′5′, and it is required to calculate the pixel valueof the first simulation pixel R5′5′ according to an association pixel ofthe first simulation pixel R5′5′ by a first interpolation algorithm.

It should be noted that, a pixel value of a pixel mentioned in thecontext should be understood in a broad sense as a color attribute valueof the pixel, such as a color value.

The association pixel is selected from an association pixel unit. Theremay be more than one association pixel unit for each first simulationpixel, for example, there may be four association pixel units, in whichthe association pixel units have the same color as the first simulationpixel and are adjacent to the image pixel unit including the originalpixel at the same position as the first simulation pixel.

It should be noted that, “adjacent” here should be understood in a broadsense. Take FIG. 10 as an example, the first simulation pixel R5′5′corresponds to the original pixel B55. The image pixel units 400, 500,600 and 700 are selected as the association pixel units, but other redimage pixel units far away from the image pixel unit where the originalpixel B55 is located are not selected as the association pixel units. Ineach association pixel unit, the red original pixel closest to theoriginal pixel B55 is selected as the association pixel, which meansthat the association pixels of the first simulation pixel R5′5′ includethe original pixels R44, R74, R47 and R77. The first simulation pixelR5′5′ is adjacent to and has the same color as the original pixels R44,R74, R47 and R77.

In different cases, the original pixels are converted into the firstsimulation pixels in different manners. Therefore, the color-block imageis converted into the first image. Since the filters in the Bayer arrayare adopted when shooting the image, the SNR of the image is improved.During the image processing procedure, the interpolation processing isperformed on the color-block image, such that the distinguishability andresolution of the image can be improved.

Referring to FIG. 11, in some implementations, the act at block 1206(i.e., determining the pixel value of the first simulation pixelaccording to a pixel value of an association pixel) includes thefollowing.

At block 12062, a change of the color of the first simulation pixel ineach direction of at least two directions is calculated according to thepixel value of the association pixel.

At block 12064, a weight in each direction of the at least twodirections is calculated according to the change.

At block 12066, the pixel value of the first simulation pixel iscalculated according to the weight and the pixel value of theassociation pixel.

In detail, the first interpolation algorithm is realized as follows:with reference to energy changes of the image in different directionsand according to weights of the association pixels in differentdirections, the pixel value of the first simulation pixel is calculatedby a linear interpolation. From the direction having a smaller energychange, it can get a higher reference value, i.e., the weight for thisdirection in the interpolation is high.

In some examples, for sake of convenience, only the horizontal directionand the vertical direction are considered.

The pixel value of the first simulation pixel R5′5′ is obtained by afirst interpolation algorithm based on the original pixels R44, R74, R47and R77. Since there is no original pixel with a same color as the firstsimulation pixel (i.e., R) in the horizontal direction and the verticaldirection of the original pixel B55 corresponding the first simulationpixel R5′5′, a component of this color (i.e., R) in each of thehorizontal direction and the vertical direction is calculated accordingto the association pixels. The components in the horizontal directionare R45 and R75, the components in the vertical direction are R54 andR57. All the components can be calculated according to the originalpixels R44, R74, R47 and R77.

In detail, R45=R44*2/3+R47*1/3, R75=2/3 *R74+1/3 *R77, R54=2/3 *R44+1/3*R74, R57=2/3 *R47+1/3 *R77.

The change of color and the weight in each of the horizontal directionand the vertical direction are calculated respectively. In other words,according to the change of color in each direction, the reference weightin each direction used in the first interpolation algorithm isdetermined. The weight in the direction with a small change is high,while the weight in the direction with a big change is low. The changein the horizontal direction is X1=|R45−R75|. The change in the verticaldirection is X2=|R54−R57|, W1=X1/(X1+X2), W2=X2/(X1+X2).

After the above calculation, the pixel value of the first simulationpixel R5′5′ can be calculated asR5′5′=(2/3*R45+1/3*R75)*W2+(2/3*R54+1/3*R57)*W1. It can be understoodthat, if X1>X2, then W1>W2. The weight in the horizontal direction isW2, and the weight in the vertical direction is W1, vice versa.

Accordingly, the pixel value of the first simulation pixel can becalculated by the first interpolation algorithm. After the calculationson the association pixels, the original pixels can be converted into thefirst simulation pixels arranged in the typical Bayer array. In otherwords, four adjacent first simulation pixels arranged in the 2-by-2array include one red first simulation pixel, two green first simulationpixels and one blue first simulation pixel.

It should be noted that, the first interpolation algorithm is notlimited to the above-mentioned method, in which only the pixel values ofpixels with a same color as the first simulation pixel in the verticaldirection and the horizontal direction are considered during calculatingthe pixel value of the first simulation pixel. In other embodiments,pixel values of pixels with other colors can also be considered.

Referring to FIG. 12, in some embodiments, before the act at block 1206,the method further includes performing a white-balance compensation onthe color-block image, as illustrated at block 1201.

Accordingly, after the act at block 1206, the method further includesperforming a reverse white-balance compensation on the first image, asillustrated at block 1207.

In detail, in some examples, when converting the color-block image intothe first image, during the interpolation, the red and blue firstsimulation pixels not only refer to the color weights of original pixelshaving the same color as the first simulation pixels, but also refer tothe color weights of original pixels with the green color. Thus, it isrequired to perform the white-balance compensation before theinterpolation to exclude an effect of the white-balance in theinterpolation calculation. In order to avoid damaging the white-balanceof the color-block image, it is required to perform the reversewhite-balance compensation on the first image after the interpolationaccording to gain values of the red, green and blue colors in thecompensation.

In this way, the effect of the white-balance in the interpolationcalculation can be excluded, and the simulation image obtained after theinterpolation can keep the white-balance of the color-block image.

Referring to FIG. 12 again, in some implementations, before the act atblock 1206, the method further includes performing a bad-pointcompensation on the color-block image, as illustrated at block 1203.

It can be understood that, limited by the manufacturing process, theremay be bad points in the image sensor 20. The bad point presents a samecolor all the time without varying with the photo-sensibility, whichaffects quality of the image. In order to ensure an accuracy of theinterpolation and prevent from the effect of the bad points, it isrequired to perform the bad-point compensation before the interpolation.

In detail, during the bad-point compensation, the original pixels aredetected. When an original pixel is detected as the bad point, thebad-point compensation is performed according to pixel values of otheroriginal pixels in the image pixel unit where the original pixel islocated.

In this way, the effect of the bad point on the interpolation can beavoided, thus improving the quality of the image.

Referring to FIG. 12 again, in some implementations, before the act atblock 1206, the method includes performing a crosstalk compensation onthe color-block image, as illustrated at block 1205.

In detail, four photosensitive pixels 2121 in one photosensitive pixelunit 212 a are covered by the filters with the same color, and thephotosensitive pixels 2121 have different photo-sensibilities, such thatfixed spectrum noise may occur in pure-color areas in the firsttrue-color image outputted after converting the first image, and thequality of the image may be affected. Therefore, it is required toperform the crosstalk compensation on the color-block image.

Referring to FIG. 13, in some implementations, after the act at block1206, the method further includes performing at least one of a mirrorshape correction, a demosaicking processing, a denoising processing andan edge sharpening processing on the first image, as illustrated atblock 1208.

It can be understood that, after the color-block image is converted intothe first image, the first simulation pixels are arranged in the typicalBayer array. The first image can be processed, during which, the mirrorshape correction, the demosaicking processing, the denoising processingand the edge sharpening processing are included, such that thesimulation true-color image can be obtained and output to the user.

In some implementations, the second part of the color-block image beyondthe brightness area needs to be processed with the second interpolationalgorithm, to convert the second part into a second image. The secondimage includes second simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one second simulation pixel. Thesecond image may be obtained by the following. An average pixel value ofeach image pixel unit of the second part of the color-block image iscalculated. It is determined whether a color of a second simulationpixel is identical to that of the original pixel at a same position asthe second simulation pixel. When the color of the second simulationpixel is identical to that of the original pixel at the same position asthe second simulation pixel, the average pixel value of an image pixelunit including the original pixel is determined as a pixel value of thesecond simulation pixel. When the color of the second simulation pixelis different from that of the original pixel at the same position as thesecond simulation pixel, an average pixel value of an image pixel unitwith a same color as the second simulation pixel and closest to an imagepixel unit including the original pixel is determined as the pixel valueof the second simulation pixel.

Referring to FIG. 14, take FIG. 14 as an example to illustrate thesecond interpolation algorithm. The average pixel value of each imagepixel unit is calculated as follows: Ravg=(R1+R2+R3+R4)/4,Gravg=(Gr1+Gr2+Gr3+Gr4)/4, Gbavg=(Gb1+Gb2+Gb3+Gb4)/4 andBavg=(B1+B2+B3+B4)/4. The pixel value of each of the original pixelsR11, R12, R13 and R14 is equal to Ravg. The pixel value of each of theoriginal pixels Gr31, Gr32, Gr41 and Gr42 is equal to Gravg. The pixelvalue of each of the original pixels Gb13, Gb14, Gb23 and Gb24 is equalto Gbavg. The pixel value of each of the original pixels B33, B34, B43and B44 is equal to Bavg. The second simulation pixel B22 is taken as anexample, the corresponding original pixel having the same positon as thesecond simulation pixel B22 is R22. Since the color of the secondsimulation pixel B22 is different from that of the correspondingoriginal pixel R22, the pixel value of the second simulation pixel B22may be determined as the pixel value corresponding to the closest bluefilter, i.e., the pixel value Bavg of any of original pixels B33, B34,B43 and B44. Similarly, the pixel values of second simulation pixelswith other colors can be determined using the second interpolationalgorithm.

For the second part of the color-block image beyond the brightness area,the second interpolation algorithm is used to convert the originalpixels into the second simulation pixels. Thus, the color-block image isconverted into the simulation image. The second interpolation algorithmhas a time complexity and a space complexity less than those of thefirst interpolation algorithm. Thus, using the second interpolationalgorithm to process the second part of the color-block beyond thebrightness area, the computing time consumed is reduced, therebyimproving the user experience.

In another aspect, the present disclosure also provides an imageprocessing apparatus.

FIG. 15 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure. Referring to FIG. 15, an imageprocessing apparatus 300 is illustrated. The image processing apparatus300 is applied in an electronic device and is configured to process acolor-block image output by an image sensor 20. As illustrated above inFIGS. 2-3 and 5-6, the image sensor 20 includes an array 212 ofphotosensitive pixel units and an array 211 of filter units arranged onthe array 212 of photosensitive pixel units. Each filter unit 211 acorresponds to one photosensitive pixel unit 212 a, and eachphotosensitive pixel unit 212 a includes a plurality of photosensitivepixels 2121. The color-block image includes image pixel units arrangedin a preset array, and each image pixel unit includes a plurality oforiginal pixels. Each photosensitive pixel unit 212 a corresponds to oneimage pixel unit, and each photosensitive pixel 2121 corresponds to oneoriginal pixel. The image processing apparatus 300 includes anon-transitory computer-readable medium 3600 and an instructionexecution system 3800. The non-transitory computer-readable medium 3600includes computer-executable instructions stored thereon. Theinstruction execution system 3800 is configured by the instructionsstored in the medium 3600 to implement at least one of an identifyingmodule 310, a first converting module 320, a second converting module330 and a merging module 340.

The identifying module 310 is configured to identify a brightness areain the color-block image. The first converting module 320 is configuredto convert a first part of color-block image within the brightness areainto a first image using a first interpolation algorithm. The firstimage includes first simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one first simulation pixel. Thesecond converting module 330 is configured to convert a second part ofthe color-block image beyond the brightness area into a second imageusing a second interpolation algorithm. The second image includes secondsimulation pixels arranged in an array, and each photosensitive pixelcorresponds to one second simulation pixel. The first interpolationalgorithm is more complex than the second interpolation algorithm. Themerging module 340 is configured to merge the first image and the secondimage to generate a simulation image corresponding to the color-blockimage.

In other words, the act at block 110 can be implemented by theidentifying module 310. The act at block 120 can be implemented by thefirst converting module 320. The act at block 130 can be implemented bythe second converting module 330. The act at block 140 can beimplemented by the merging module 340.

Referring to FIG. 16, the identifying module 310 includes a dividingunit 3102, a calculating unit 3104, and a combining unit 3106. Thedividing unit 3102 is configured to divide the color-block image into aplurality of analysis areas. The calculating unit 3104 is configured tocalculate a brightness value for each analysis area. The combining unit3106 is configured to combine the analysis areas each with thebrightness value greater than a preset threshold as the brightness area.

In other words, the act at block 1101 can be implemented by the dividingunit 3102. The act at block 1102 can be implemented by the calculatingunit 3104. The act at block 1103 can be implemented by the combiningunit 3106.

In some implementations, the plurality of analysis areas are arranged inan array.

Referring to FIG. 17, in some implementations, the first convertingmodule 320 includes a first determining unit 3202, a second determiningunit 3204 and a third determining unit 3206. The first determining unit3202 is configured to determine whether a color of a first simulationpixel is identical to that of an original pixel at a same position asthe first simulation pixel. The second determining unit 3204 isconfigured to determine a pixel value of the original pixel as a pixelvalue of the first simulation pixel, when the color of the firstsimulation pixel is identical to that of the original pixel at the sameposition as the first simulation pixel. The third determining unit 3206is configured to determine the pixel value of the first simulation pixelaccording to a pixel value of an association pixel, when the color ofthe first simulation pixel is different from that of the original pixelat the same position as the first simulation pixel, in which theassociation pixel is selected from an image pixel unit with a same coloras the first simulation pixel and adjacent to an image pixel unitincluding the original pixel.

In other words, the act at block 1202 can be implemented by the firstdetermining unit 3202. The act at block 1204 can be implemented by thesecond determining unit 3204. The act at block 1206 can be implementedby the third determining unit 3206.

Referring to FIG. 18, the third determining unit 3206 includes a firstcalculating sub-unit 32062, a second calculating sub-unit 32064 and athird calculating sub-unit 32066. The first calculating sub-unit 32062is configured to calculate a change of the color of the first simulationpixel in each direction of at least two directions according to thepixel value of the association pixel. The second calculating sub-unit32064 is configured to calculate a weight in each direction of the atleast two directions according to the change. The third calculatingsub-unit 32066 is configured to calculate the pixel value of the firstsimulation pixel according to the weight and the pixel value of theassociation pixel.

In other words, the act at block 12062 can be implemented by the firstcalculating sub-unit 32062. The act at block 12064 can be implemented bythe second calculating sub-unit 32064. The act at block 12066 can beimplemented by the third calculating sub-unit 32066.

Referring to FIG. 19, in some implementations, the first convertingmodule 320 further includes a first compensating unit 3201 and arestoring unit 3207. The first compensating unit 3201 is configured toperform a white-balance compensation on the color-block image before thecolor-block image is converted into the simulation image. The restoringmodule 3207 is configured to perform a reverse white-balancecompensation on the simulation image.

In other words, the act at block 1201 can be implemented by the firstcompensating unit 3201, and the act at block 1207 can be implemented bythe restoring unit 3207.

Referring to FIG. 19 again, in some implementations, the firstconverting module 320 further includes a second compensating unit 3203and a third compensating unit 3205. The second compensating unit 3203 isconfigured to perform at least one of a bad-point compensation and acrosstalk compensation on the color-block image. The third compensationunit 3205 is configured to perform a crosstalk compensation on thecolor-block image. In other words, the act at block 1203 can beimplemented by the second compensating unit 3203. The act at block 1205can be implemented by the third compensating unit 3205.

Referring to FIG. 19 again, in some implementations, the firstconverting module 320 further includes a processing unit 3208. Theprocessing unit 3108 is configured to perform at least one of a mirrorshape correction, a demosaicking processing, a denoising processing andan edge sharpening processing on the simulation image. In other words,the act at block 1208 can be implemented by the third processing unit3208.

The present disclosure also provides an electronic device.

FIG. 20 is a block diagram of an electronic device 1000 according to anembodiment of the present disclosure.

Referring to FIG. 20, the electronic device 1000 of the presentdisclosure includes a housing 1001, a processor 1002, a memory 1003, acircuit board 1006, a power supply circuit 1007, and an imagingapparatus 100. The circuit board 1006 is enclosed by the housing 1001.The processor 1002 and the memory 1003 are positioned on the circuitboard 1006. The power supply circuit 1007 is configured to provide powerfor respective circuits or components of the electronic device 1000. Thememory 1003 is configured to store executable program codes. The imagingapparatus 100 includes an image sensor 20. As illustrated above, theimage sensor 20 includes an array 212 of photosensitive pixel units andan array 211 of filter units arranged on the array 212 of photosensitivepixel units. Each filter unit 211 a corresponds to one photosensitivepixel unit 212 a, and each photosensitive pixel unit 212 a includes aplurality of photosensitive pixels 2121.

The processor 1002 is configured to run a program corresponding to theexecutable program codes by reading the executable program codes storedin the memory 1003, to perform following operations. A brightness areais identified in the color-block image. A first part of the color-blockimage within the brightness area is converted into a first image using afirst interpolation algorithm. The first image includes first simulationpixels arranged in an array, and each photosensitive pixel correspondsto one first simulation pixel. A second part of the color-block imagebeyond the brightness area is converted into a second image using asecond interpolation algorithm. The second image includes secondsimulation pixels arranged in an array, each photosensitive pixelcorresponds to one second simulation pixel. The first interpolationalgorithm is more complex than the second interpolation algorithm. Thefirst image and the second image are merged to generate a simulationimage corresponding to the color-block image. In some embodiments, theelectronic device 1000 may include a touch screen 1008.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to identify thebrightness by acts of: dividing the color-block image into a pluralityof analysis areas; calculating a brightness value for each analysisarea; and combining the analysis areas each with the brightness valuegreater than a preset threshold as the brightness area.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to convert the firstpart of the color-block image within the brightness area into the firstimage using the first interpolation algorithm by acts of: determiningwhether a color of a first simulation pixel is identical to that of anoriginal pixel at a same position as the first simulation pixel; whenthe color of the first simulation pixel is identical to that of theoriginal pixel at the same position as the first simulation pixel,determining a pixel value of the original pixel as a pixel value of thefirst simulation pixel; and when the color of the first simulation pixelis different from that of the original pixel at the same position as thefirst simulation pixel, determining the pixel value of the firstsimulation pixel according to a pixel value of an association pixel, inwhich the association pixel is selected from an image pixel unit with asame color as the first simulation pixel and adjacent to an image pixelunit including the original pixel.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to determine thepixel value of the first simulation pixel according to the pixel valueof the association pixel by acts of: calculating a change of the colorof the first simulation pixel in each direction of at least twodirections according to the pixel value of the association pixel;calculating a weight in each direction of the at least two directionsaccording to the change; and calculating the pixel value of the firstsimulation pixel according to the weight and the pixel value of theassociation pixel.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperations: performing a white-balance compensation on the color-blockimage before the color-block image is converted; and performing areverse white-balance compensation on the simulation image after thesimulation image is acquired.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperation: performing at least one of a bad-point compensation and acrosstalk compensation on the color-block image.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperations: performing at least one of a mirror shape correction, ademosaicking processing, a denoising processing and an edge sharpeningprocessing on the simulation image.

In some implementations, the imaging apparatus includes a front cameraor a real camera (not illustrated in FIG. 20).

It may be understood that, electronic device 1000 generally includesboth of the front camera and the rear camera. Images captured by thefront camera and the rear camera may be processed with the imageprocessing method according to embodiments of the present disclosure,thus improving the user experience.

In some implementations, the electronic device may be a mobile phone ora tablet computer, which is not limited herein.

The mobile phone and the tablet computer both include an imagingapparatus 100. When the mobile phone or the tablet computer is used tocapture an image, the image may be processed with the image processingmethod according to embodiments of the present disclosure, so as toimprove the distinguishability and the resolution of the image.

It may be understood that, other electronic device having a capacity ofcapturing images may be included.

The electronic device 1000 may further include an inputting component(not illustrated in FIG. 20). It should be understood that, theinputting component may further include one or more of the following: aninputting interface, a physical button of the electronic device 1000, amicrophone, etc.

It should be understood that, the electronic device 1000 may furtherinclude one or more of the following components (not illustrated in FIG.20): an audio component, an input/output (I/O) interface, a sensorcomponent and a communication component. The audio component isconfigured to output and/or input audio signals, for example, the audiocomponent includes a microphone. The I/O interface is configured toprovide an interface between the processor 1002 and peripheral interfacemodules. The sensor component includes one or more sensors to providestatus assessments of various aspects of the electronic device 1000. Thecommunication component is configured to facilitate communication, wiredor wirelessly, between the electronic device 1000 and other devices.

It is to be understood that phraseology and terminology used herein withreference to device or element orientation (such as, terms like“center”, “longitudinal”, “lateral”, “length”, “width”, “height”, “up”,“down”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”,“top”, “bottom”, “inside”, “outside”, “clockwise”, “anticlockwise”,“axial”, “radial”, “circumferential”) are only used to simplifydescription of the present invention, and do not indicate or imply thatthe device or element referred to must have or operated in a particularorientation. They cannot be seen as limits to the present disclosure.

Moreover, terms of “first” and “second” are only used for descriptionand cannot be seen as indicating or implying relative importance orindicating or implying the number of the indicated technical features.Thus, the features defined with “first” and “second” may comprise orimply at least one of these features. In the description of the presentdisclosure, “a plurality of” means two or more than two, unlessspecified otherwise.

In the present disclosure, unless specified or limited otherwise, theterms “mounted,” “connected,” “coupled,” “fixed” and the like are usedbroadly, and may be, for example, fixed connections, detachableconnections, or integral connections; may also be mechanical orelectrical connections; may also be direct connections or indirectconnections via intervening structures; may also be inner communicationsof two elements or interactions of two elements, which can be understoodby those skilled in the art according to specific situations.

In the present disclosure, unless specified or limited otherwise, astructure in which a first feature is “on” a second feature may includean embodiment in which the first feature directly contacts the secondfeature, and may also include an embodiment in which the first featureindirectly contacts the second feature via an intermediate medium.Moreover, a structure in which a first feature is “on”, “over” or“above” a second feature may indicate that the first feature is rightabove the second feature or obliquely above the second feature, or justindicate that a horizontal level of the first feature is higher than thesecond feature. A structure in which a first feature is “below”, or“under” a second feature may indicate that the first feature is rightunder the second feature or obliquely under the second feature, or justindicate that a horizontal level of the first feature is lower than thesecond feature.

Various embodiments and examples are provided in the followingdescription to implement different structures of the present disclosure.In order to simplify the present disclosure, certain elements andsettings will be described. However, these elements and settings areonly examples and are not intended to limit the present disclosure. Inaddition, reference numerals may be repeated in different examples inthe disclosure. This repeating is for the purpose of simplification andclarity and does not refer to relations between different embodimentsand/or settings. Furthermore, examples of different processes andmaterials are provided in the present disclosure. However, it would beappreciated by those skilled in the art that other processes and/ormaterials may be also applied.

Reference throughout this specification to “an embodiment,” “someembodiments,” “an example,” “a specific example,” or “some examples,”means that a particular feature, structure, material, or characteristicdescribed in connection with the embodiment or example is included in atleast one embodiment or example of the present disclosure. In thisspecification, exemplary descriptions of aforesaid terms are notnecessarily referring to the same embodiment or example. Furthermore,the particular features, structures, materials, or characteristics maybe combined in any suitable manner in one or more embodiments orexamples. Moreover, those skilled in the art could combine differentembodiments or different characteristics in embodiments or examplesdescribed in the present disclosure.

Any process or method described in a flow chart or described herein inother ways may be understood to include one or more modules, segments orportions of codes of executable instructions for achieving specificlogical functions or steps in the process, and the scope of a preferredembodiment of the present disclosure includes other implementations,wherein the order of execution may differ from that which is depicted ordiscussed, including according to involved function, executingconcurrently or with partial concurrence or in the contrary order toperform the function, which should be understood by those skilled in theart.

The logic and/or step described in other manners herein or shown in theflow chart, for example, a particular sequence table of executableinstructions for realizing the logical function, may be specificallyachieved in any computer readable medium to be used by the instructionexecution system, device or equipment (such as the system based oncomputers, the system comprising processors or other systems capable ofacquiring the instruction from the instruction execution system, deviceand equipment and executing the instruction), or to be used incombination with the instruction execution system, device and equipment.As to the specification, “the computer readable medium” may be anydevice adaptive for including, storing, communicating, propagating ortransferring programs to be used by or in combination with theinstruction execution system, device or equipment. More specificexamples of the computer-readable medium comprise but are not limitedto: an electronic connection (an electronic device) with one or morewires, a portable computer enclosure (a magnetic device), a randomaccess memory (RAM), a read-only memory (ROM), an erasable programmableread-only memory (EPROM or a flash memory), an optical fiber device anda portable compact disk read-only memory (CDROM). In addition, thecomputer-readable medium may even be a paper or other appropriate mediumcapable of printing programs thereon, this is because, for example, thepaper or other appropriate medium may be optically scanned and thenedited, decrypted or processed with other appropriate methods whennecessary to obtain the programs in an electric manner, and then theprograms may be stored in the computer memories.

It should be understood that each part of the present disclosure may berealized by hardware, software, firmware or their combination. In theabove embodiments, a plurality of steps or methods may be realized bythe software or firmware stored in the memory and executed by theappropriate instruction execution system. For example, if it is realizedby the hardware, likewise in another embodiment, the steps or methodsmay be realized by one or a combination of the following techniquesknown in the art: a discrete logic circuit having a logic gate circuitfor realizing a logic function of a data signal, an application-specificintegrated circuit having an appropriate combination logic gate circuit,a programmable gate array (PGA), a field programmable gate array (FPGA),etc.

Those skilled in the art shall understand that all or parts of the stepsin the above exemplifying method for the present disclosure may beachieved by commanding the related hardware with programs, the programsmay be stored in a computer-readable storage medium, and the programscomprise one or a combination of the steps in the method embodiments ofthe present disclosure when running on a computer.

In addition, each function cell of the embodiments of the presentdisclosure may be integrated in a processing module, or these cells maybe separate physical existence, or two or more cells are integrated in aprocessing module. The integrated module may be realized in a form ofhardware or in a form of software function modules. When the integratedmodule is realized in a form of software function module and is sold orused as a standalone product, the integrated module may be stored in acomputer-readable storage medium.

The storage medium mentioned above may be read-only memories, magneticdisks, CD, etc.

Although embodiments of present disclosure have been shown and describedabove, it should be understood that above embodiments are justexplanatory, and cannot be construed to limit the present disclosure,for those skilled in the art, changes, alternatives, and modificationscan be made to the embodiments without departing from spirit, principlesand scope of the present disclosure.

What is claimed is:
 1. An image processing method, configured to converta color-block image into a simulation image in an imaging apparatus,wherein the imaging apparatus comprises an image sensor, the imagesensor comprises an array of photosensitive pixel units and an array offilter units arranged on the array of photosensitive pixel units, eachfilter unit corresponds to one photosensitive pixel unit, eachphotosensitive pixel unit comprises a plurality of photosensitivepixels; the color-block image comprises image pixel units arranged in apreset array, each image pixel unit comprises a plurality of originalpixels, each photosensitive pixel corresponds to one original pixel; theimage processing method comprises: dividing the color-block image into aplurality of analysis areas; calculating a brightness value for eachanalysis area; and combining the analysis areas each with the brightnessvalue satisfying a predetermined condition as the brightness area;converting the color-block image into the simulation image, wherein, thesimulation image comprises a plurality of simulation pixels arranged inan array, the plurality of simulation pixels comprise a current pixel,the plurality of original pixels comprise an association pixelcorresponding to the current pixel, the association pixel is located inthe color-block image at a position corresponding to a position of thecurrent pixel in the simulation image, the color-block image comprisesthe brightness area; and converting the color-block image into thesimulation image comprises: determining whether the association pixel iswithin the brightness area; when the association pixel is within thebrightness area, determining whether a color of the current pixel isidentical to that of the association pixel; when the color of thecurrent pixel is identical to that of the association pixel, determininga pixel value of the association pixel as a pixel value of the currentpixel; and when the color of the current pixel is different from that ofthe association pixel, calculating the pixel value of the current pixelaccording to a pixel value of an association pixel unit through a firstinterpolation algorithm, wherein the image pixel unit comprises theassociation pixel unit, and the association pixel unit has a same coloras the current pixel and is adjacent to the association pixel; and whenthe association pixel is not within the brightness area, calculating thepixel value of the current pixel through a second interpolationalgorithm, wherein a complexity of the first interpolation algorithm isgreater than that of the second interpolation algorithm.
 2. The imageprocessing method according to claim 1, wherein the plurality ofanalysis areas are arranged in an array.
 3. The image processing methodaccording to claim 1, wherein each analysis area comprises one or moreoriginal pixels.
 4. The image processing method according to claim 1,wherein the preset array comprises a Bayer array.
 5. The imageprocessing method according to claim 1, wherein the image pixel unitcomprises original pixels arranged in a 2-by-2 array.
 6. The imageprocessing method according to claim 1, wherein calculating the pixelvalue of the current pixel according to the pixel value of theassociation pixel unit through the first interpolation algorithmcomprises: calculating a change of the association pixel in eachdirection; calculating a weight of the association pixel in eachdirection; and calculating the pixel value of the current pixelaccording to the weight and the change of the association pixel.
 7. Theimage processing method according to claim 1, further comprising:performing a white-balance compensation on the color-block image beforecalculating the pixel value of the current pixel according to a pixelvalue of an association pixel unit through a first interpolationalgorithm; and performing a reverse white-balance compensation on thesimulation image after calculating the pixel value of the current pixelaccording to a pixel value of an association pixel unit through a firstinterpolation algorithm.
 8. The image processing method according toclaim 1, before calculating the pixel value of the current pixelaccording to a pixel value of an association pixel unit through a firstinterpolation algorithm, further comprising: performing at least one ofa bad-point compensation and a crosstalk compensation on the color-blockimage.
 9. The image processing method according to claim 1, aftercalculating the pixel value of the current pixel according to a pixelvalue of an association pixel unit through a first interpolationalgorithm, further comprising: performing at least one of a mirror shapecorrection, a demosaicking processing, a denoising processing and anedge sharpening processing on the simulation image.
 10. An imageprocessing apparatus, configured to convert a color-block image into asimulation image in an imaging apparatus, wherein the imaging apparatuscomprises an image sensor, the image sensor comprises an array ofphotosensitive pixel units and an array of filter units arranged on thearray of photosensitive pixel units, each filter unit corresponds to onephotosensitive pixel unit, each photosensitive pixel unit comprises aplurality of photosensitive pixels; the color-block image comprisesimage pixel units arranged in a preset array, each image pixel unitcomprises a plurality of original pixels, each photosensitive pixelcorresponds to one original pixel; the image processing apparatuscomprises a non-transitory computer-readable medium comprisingcomputer-executable instructions stored thereon, and an instructionexecution system which is configured by the instructions to implement atleast one of: a dividing module, configured to divide the color-blockimage into a plurality of analysis areas; a calculating module,configured to calculate a brightness value for each analysis area; and acombining module, configured to combine the analysis areas each with thebrightness value satisfying a predetermined condition as the brightnessarea; a first converting module, configured to convert the color-blockimage into the simulation image, wherein, the simulation image comprisesa plurality of simulation pixels arranged in an array, the plurality ofsimulation pixels comprise a current pixel, the plurality of originalpixels comprise an association pixel corresponding to the current pixel,the association pixel is located in the color-block image at a positioncorresponding to a position of the current pixel in the simulationimage, the color-block image comprises the brightness area; and thefirst converting module comprises: a first determining unit, configuredto determine whether the association pixel is within the brightnessarea; a second determining unit, configured to, when the associationpixel is within the brightness area, determine whether a color of thecurrent pixel is identical to that of the association pixel; a firstcalculating unit, configured to, when the color of the current pixel isidentical to that of the association pixel, determine a pixel value ofthe association pixel as a pixel value of the current pixel; and asecond calculating unit, configured to, when the color of the currentpixel is different from that of the association pixel, calculate thepixel value of the current pixel according to a pixel value of anassociation pixel unit through a first interpolation algorithm, whereinthe image pixel unit comprises the association pixel unit, and theassociation pixel unit has a same color as the current pixel and isadjacent to the association pixel; and a third calculating unit,configured to, when the association pixel is not within the brightnessarea, calculate the pixel value of the current pixel through a secondinterpolation algorithm, wherein a complexity of the first interpolationalgorithm is greater than that of the second interpolation algorithm.11. The image processing apparatus according to claim 10, wherein theplurality of analysis areas are arranged in an array.
 12. The imageprocessing apparatus according to claim 10, wherein each analysis areacomprises one or more original pixels.
 13. The image processingapparatus according to claim 10, wherein the preset array comprises aBayer array.
 14. The image processing apparatus according to claim 10,wherein the image pixel unit comprises original pixels arranged in a2-by-2 array.
 15. The image processing apparatus according to claim 10,wherein the second calculating unit comprises: a first calculatingsub-unit, configured to calculate a change the association pixel in eachdirection; a second calculating sub-unit, configured to calculate aweight of the association pixel in each direction; and a thirdcalculating sub-unit, configured to calculate the pixel value of thecurrent pixel according to the weight and the change of the associationpixel.
 16. The image processing apparatus according to claim 10, whereinthe first converting module comprises: a first compensating unit,configured to perform a white-balance compensation on the color-blockimage; and a restoring unit, configured to perform a reversewhite-balance compensation on the simulation image.
 17. The imageprocessing apparatus according to claim 10, wherein the first convertingmodule comprises at least one of a second compensating unit and a thirdcompensating unit; wherein: the second compensating unit is configuredto perform a bad-point compensation on the color-block image; and thethird compensating unit is configured to perform a crosstalkcompensation on the color-block image.
 18. The image processingapparatus according to claim 10, wherein the first converting modulecomprises: a processing unit, configured to perform at least one of amirror shape correction, a demosaicking processing, a denoisingprocessing and an edge sharpening processing on the simulation image.19. An electronic device, comprising a touch screen, and an imagingapparatus, wherein the imaging apparatus comprises: an image processingapparatus, configured to convert a color-block image into a simulationimage in an imaging apparatus, wherein the imaging apparatus comprisesan image sensor, the image sensor comprises an array of photosensitivepixel units and an array of filter units arranged on the array ofphotosensitive pixel units, each filter unit corresponds to onephotosensitive pixel unit, each photosensitive pixel unit comprises aplurality of photosensitive pixels; the color-block image comprisesimage pixel units arranged in a preset array, each image pixel unitcomprises a plurality of original pixels, each photosensitive pixelcorresponds to one original pixel; the image processing apparatuscomprises a non-transitory computer-readable medium comprisingcomputer-executable instructions stored thereon, and an instructionexecution system which is configured by the instructions to implement atleast one of: a dividing module, configured to divide the color-blockimage into a plurality of analysis areas; a calculating module,configured to calculate a brightness value for each analysis area; and acombining module, configured to combine the analysis areas each with thebrightness value satisfying a predetermined condition as the brightnessarea; a first converting module, configured to convert the color-blockimage into the simulation image, wherein, the simulation image comprisesa plurality of simulation pixels arranged in an array, the plurality ofsimulation pixels comprise a current pixel, the plurality of originalpixels comprise an association pixel corresponding to the current pixel,the association pixel is located in the color-block image at a positioncorresponding to a position of the current pixel in the simulationimage, the color-block image comprises the brightness area; and thefirst converting module comprises: a first determining unit, configuredto determine whether the association pixel is within the brightnessarea; a second determining unit, configured to, when the associationpixel is within the brightness area, determine whether a color of thecurrent pixel is identical to that of the association pixel; a firstcalculating unit, configured to, when the color of the current pixel isidentical to that of the association pixel, determine a pixel value ofthe association pixel as a pixel value of the current pixel; and asecond calculating unit, configured to, when the color of the currentpixel is different from that of the association pixel, calculate thepixel value of the current pixel according to a pixel value of anassociation pixel unit through a first interpolation algorithm, whereinthe image pixel unit comprises the association pixel unit, and theassociation pixel unit has a same color as the current pixel and isadjacent to the association pixel; and a third calculating unit,configured to, when the association pixel is not within the brightnessarea, calculate the pixel value of the current pixel through a secondinterpolation algorithm, wherein a complexity of the first interpolationalgorithm is greater than that of the second interpolation algorithm.20. The electronic device according to claim 19, wherein the imagingapparatus comprises a front camera or a rear camera.